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Abstract. Canonical Polyadic Decomposition (CPD) of a higher-order tensor is decomposition 
in a minimal number of rank-1 tensors. We give an overview of existing results concerning unique- 
ness. We present new, relaxed, conditions that guarantee uniqueness of one factor matrix. These 
conditions involve Khatri-Rao products of compound matrices. We make links with existing results 
involving ranks and k-ranks of factor matrices. We give a shorter proof, based on properties of sec- 
ond compound matrices, of existing results concerning overall CPD uniqueness in the case where one 
factor matrix has full column rank. We develop basic material involving m-th compound matrices 
that will be instrumental in Part II for establishing overall CPD uniqueness in cases where none of 
the factor matrices has full column rank. 
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1. Introduction. 

1.1. Problem statement. Throughout the paper F denotes the field of real or 
complex numbers; (-) T denotes transpose; r&_ and range(A) denote the rank and the 
range of a matrix A, respectively; Diag(d) denotes a square diagonal matrix with the 
elements of a vector d on the main diagonal; w(d) denotes the number of nonzero 
components of d; C% denotes the binomial coefficient, = m^Zfcj] i O mx „, m , and 
I„ are the zero m x n matrix, the zero m x 1 vector, and the n x n identity matrix, 
respectively. 

We have the following basic definitions. 

Definition 1.1. A third order-tensor T G f Jx,7><k is rank-1 if it equals the 
outer product of three nonzero vectors aeF', b€F J and c G , which means that 
Ujk = OibjCk for all values of the indices. 

A rank-1 tensor is also called a simple tensor or a decomposable tensor. The outer 
product in the definition is written as T = aoboc. 

Definition 1.2. A Polyadic Decomposition (PD) of a third-order tensor T G 
■^IxJxK eX p resses J~ as a sum of rank-1 terms: 

B 

T = 2^a r ob r oc r) (1-1) 

r=l 

where a r 6 W 1 , h r G F J , c r £ ¥ K , 1 < r < R. 
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We call the matrices A = [ai ... a R ] e ¥ IxR , B = [bi ... h R ] e ¥ JxR 
and C = [ci ... c^] <E pKxR ^ e g rs ^ second and third factor matrix of T, 
respectively. We also write as T = [A, B, C] R . 

Definition 1.3. The rank of a tensor T G jp-fxJxK j s defined as the minimum 
number of rank-1 tensors in a PD of T and is denoted by rj-. 

In general, the rank of a third-order tensor depends on F [21]: a tensor over M. 
may have a different rank than the same tensor considered over C. 

Definition 1.4. A Canonical Polyadic Decomposition (CPD) of a third-order 
tensor T expresses T as a minimal sum of rank-1 terms. 

Note that T = [A, B, C] R is a CPD of T if and only if R = r T . 

Let us reshape T into a vector t G jr-f^xi anc j a matrix T £ F /JxAr as follows: 
the (i, j, fc)-th entry of T corresponds to the ((i — 1)JK + (j — 1)K + k)-th entry of 
t and to the ((i — 1) J + j, fc)-th entry of T. In particular, the rank-1 tensor aoboc 
corresponds to the vector a eg) b ® c and to the rank-1 matrix (a <g> b)c T , where "<8>" 
denotes the Kronecker product: 

a<g)b=[aib T ... a/b T ] T = \aib\ . . . a\bj ... aib\ . . .a/6j] T . 

Thus, (jl.ljl can be identified either with 

R 

t = a r (3 b r ® c r , (1-2) 

r=l 

or with the matrix decomposition 

T = J^(a r ® b r )c^. (1.3) 

r=l 

Further, (|1.3I) can be rewritten as a factorization of T, 

T = (A©B)C T , (1.4) 

where "0" denotes the Khatri-Rao product of matrices: 

A © B := [ai (8) b x • • • a B h R ] e W IJxR . 

It is clear that in (|l.ip - (|1.3p the rank-1 terms can be arbitrarily permuted and that 
vectors within the same rank-1 term can be arbitrarily scaled provided the overall 
rank-1 term remains the same. The CPD of a tensor is unique when it is only subject 
to these trivial indeterminacies. 

In this paper we find sufficient conditions on the matrices A, B, and C which 
guarantee that the CPD of T = [A, B, C] R is partially unique in the following sense: 
the third factor matrix of any other CPD of T coincides with C up to permutation 
and scaling of columns. In such a case we say that the third factor matrix of T is 
unique. We also develop basic material involving m-th compound matrices that will 
be instrumental in Part II for establishing overall CPD uniqueness. 

1.2. Literature overview. The CPD was introduced by F.L. Hitchcock in [14] . 
It has been rediscovered a number of times and called Canonical Decomposition (Can- 
decomp) [T], Parallel Factor Model (Parafac) [111113) . and Topographic Components 
Model [21]. Key to many applications are the uniqueness properties of the CPD. 
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Contrary to the matrix case, where there exist (infinitely) many rank-revealing de- 
compositions, CPD may be unique without imposing constraints like orthogonality. 
Such constraints cannot always be justified from an application point of view. In 
this sense, CPD may be a meaningful data representation, and actually reveals a 
unique decomposition of the data in interpretable components. CPD has found many 
applications in Signal Processing [2] , [3] , Data Analysis [19] , Chemometrics [29] , Psy- 
chometrics pQ, etc. We refer to the overview papers [3]I7]I17] and the references therein 
for background, applications and algorithms. We also refer to [3D] for a discussion of 
optimization-based algorithms. 

1.2.1. Early results on uniqueness of the CPD. In [11] p. 61] the following 
result concerning the uniqueness of the CPD is attributed to R. Jennrich. 

Theorem 1.5. LetT= [A,B,C]_r and let 

r A = r B = r c = R. (1.5) 

Then rj- = R and the CPD T = [A, B, C]r is unique. 
Condition (|1.5[) may be relaxed as follows. 
Theorem 1.6. gE[ LetT= [A,B,C] R , let 

r A = r B = R and let any two columns of C be linearly independent. 

Then rj- = R and the CPD T = [A, B, C]r is unique. 

1.2.2. Kruskal's conditions. A further relaxed result is due to J. Kruskal. To 
present Kruskal's theorem we recall the definition of fc-rank ("k" refers to "Kruskal"). 

Definition 1.7. The k-rank of a matrix A is the largest number k A such that 
every subset of k A columns of the matrix A is linearly independent. 

Obviously, k A < r A . Note that the notion of the /c-rank is closely related to the 
notions of girth, spark, and ^-stability [23] Lemma 5.2, p. 317] and references therein. 
The famous Kruskal theorem states the following. 

Theorem 1.8. [20] Let T = [A,B,C] R and let 

k A + k B + k c >2R + 2. (1.6) 

Then rj- — R and the CPD of T — [A, B, C]^ is unique. 

Kruskal's original proof was made more accessible in [32] and was simplified in [22] 
Theorem 12.5.3.1, p. 306]. In [25] an other proof of Theorem 11.81 is given. 

Before Kruskal arrived at Theorem 11.81 he obtained results about uniqueness of 
one factor matrix [30] Theorem 3a-3d, p. 115-116]. These results were flawed. Here 
we present their corrected versions. 

Theorem 1.9. JP[ Theorem 2.3} (for original formulation see \2(A Theorems 
3a, b]) Let T = [A, B, C]r and suppose 

'fee > 1, 

< r c + min(fc A , k B )>R + 2, (1.7) 
r c + k A + k B + max(r A — k A} r B - k B ) >2R + 2. 

Then rj- = R and the third factor matrix of T is unique. 

Let the matrices A and B have R columns. Let A be any set of columns of A, let 
B be the corresponding set of columns of B. We will say that condition (Hm) holds 
for the matrices A and B if 

H(S) := min [r A + r^ - 5] > min(<5, m) for S=1,2,...,R. (Hm) 

card(A.)—S 



4 



IGNAT DOMANOV AND LIEVEN DE LATHAUWER 



Theorem 1.10. (see for original formulation see \2(A Theorems 3d]) Let 
T = [A. B, C\r and m := R — rc + 2. Assume that 

(i) fcc > 1; 

(ii) (Hm) holds for A and B. 

Then rj- = R and the third factor matrix of T is unique. 

Kruskal also obtained results about overall uniqueness that are more general than 
Thcorcm ll.81 These results will be discussed in Part II [5]. 

1.2.3. Uniqueness of the CPD when one factor matrix has full column 
rank. We say that a K x R matrix has full column rank if its column rank is R, 
which implies K > R. 

Let us assume that rc = R- The following result concerning uniqueness of the 
CPD was obtained by T. Jiang and N. Sidiropoulos in [16]. We reformulate the result 
in terms of the Khatri-Rao product of the second compound matrices of A and B. 
The A:-th compound matrix of an / x R matrix A (denoted by Cfc(A)) is the Cj x C R 
matrix containing the determinants of all k x k submatrices of A, arranged with the 
submatrix index sets in lexicographic order (see Definition 12.11 and Example 12.21) . 

Theorem 1.11. 2H Condition A, p. 2628, Condition B and eqs. (16) and (17), 
p. 2630] Let A e¥ IxR , B e F Jxfl , C eF M and r c = R- Then the following 
statements are equivalent: 

(i) if d € ¥ R is such that TADiag(d)B T < L then u>(d) < 1; 

(ii) if d € ¥ R is such that 

(C 2 (A) ©Ca(B)) [did 2 d!d 3 ... d x d R d 2 d 3 ... d R - 1 d R ] T = 0, 

then w(d) < 1; (U2) 

(iii) r 7- = R and the CPD ofT— [A, B, is unique. 

Papers [16j and [5] contain the following more restrictive sufficient condition for 
CPD uniqueness, formulated differently. This condition can be expressed in terms of 
second compound matrices as follows. 

Theorem 1.12. f3 Remark 1, p. 652], JW$ Let T = [A,B,C] fi , r c = R, and 
suppose 

U = C2(A) 02(B) has full column rank. (C2) 

Then r-j- — R and the CPD of T is unique. 

It is clear that (C2) implies (U2). If rc = R, then Kruskal's condition (| 1 .€>[) is 
more restrictive than condition (C2). 

Theorem 1.13. H3 Proposition 3.2, p. 215 and Lemma 44, p. 221] Let 
T = [A, B, C] R and let r c = R. If 



r A + k B >R + 2, ( r B + k A > R 

k A >2 '" 1 fc B >2, 



(K2) 



then (C2) holds. Hence, rj- — R and the CPD of T is unique. 

Thcorem ll,13l is due to A. Stegeman [22 Proposition 3.2, p. 215 and Lemma 4.4, 
p. 221]. Recently, another proof of Theorem 11.131 has been obtained in (TOJ Theorem 
1, p. 3477]. 

Assuming rc = R, the conditions of Theorems 11.81 through [TTTBI are related by 
k A + k B + k c >2R + 2 (Ka) => (Ca) => (U2) 

(1.8) 

<^4> rj- — R and the CPD of T is unique. 
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1.2.4. Necessary conditions for uniqueness of the CPD. Results con- 
cerning rank and fc-rank of Khatri-Rao product. It was shown in [33] that 
condition (|1.6[) is not only sufficient but also necessary for the uniqueness of the CPD 
if R = 2 or R = 3. Moreover, it was proved in [34] that if R = 4 and if the fc-ranks of 
the factor matrices coincide with their ranks, then the CPD of [A, B, C]4 is unique if 
and only if condition (|1.6j) holds. Passing to higher values of R we have the following 
theorems. 

Theorem 1.14. J23 p. 651], fM P- 2079, Theorem 2], fM P- 28] Let 
T = [A, B, C\r, rj- = R > 2, and let the CPD ofT be unique. Then 

(i) AoB, B © C, C©A have full column rank; 

(ii) min(fcA, ^b, fee) > 2. 

Theorem 1.15. Theorem 2.3] Let T = [A, B, C] R , r r = R > 2, and let the 
CPD ofT be unique. Then the condition (U2) holds for the pairs (A, B), (B, C) ; and 
(C,A). 

Theorem 11.151 gives more restrictive uniqueness conditions than Theorem 11.141 
and generalizes the implication (iii)=>(ii) of Theorem II. Ill to CPDs with re < R- 
The following lemma gives a condition under which 

A B has full column rank. (Ci) 



Lemma 1.16. {23 Lemma 1, p. 3477] Let A G ¥ IxR and B G ¥ JxR . If 
r A + k B > R+ 1, f r B + k A > R :+ 1, 



then (Ci) holds. 

We conclude this section by mentioning two important corollaries that we will 

use. 

Corollary 1.17. Lemma 1, p. 2382] If k A + k B > R+l, then (Ci) holds. 

Corollary 1.18. |Hl Lemma 1, p. 231] If k A > 1 and fc B > 1, then 
k A QB > mm(k A + fc B - 1, R). 

The proof of Corollary 1 1.1 81 in [2"B] was based on Corollary 1 1.1 71 Other proofs are 
given in [26l Lemma 1, p. 231] and [32 Lemma 3.3, p. 544]. (The proof in [32] is due 
to J. Ten Berge, see also [35].) All mentioned proofs are based on the Sylvester rank 
inequality. 

1.3. Results and organization. Motivated by the conditions appearing in the 
various theorems of the preceding section, we formulate more general versions, de- 
pending on an integer parameter to. How these conditions, in conjunction with other 
assumptions, imply the uniqueness of one particular factor matrix will be the core of 
our work. 

To introduce the new conditions we need the following notation. With a vector 
d = [di ... oIr\ we associate the vector 

d m := [di ■ ■ ■ d m d x ■ ■ ■ d m _id m+ i . . . dR- m +i ■ ■ ■ d R ] T G F c « , (1.9) 

whose entries are all products d^ ■ ■ ■ di m with 1 < i\ < ■ ■ ■ < i m < R. Let us 
define conditions (Km), (Cm), (Um) and (Wm), which depend on matrices A G ¥ IxR , 



() 



IGNAT DOMANOV AND LIEVEN DE LATHAUWER 



B e ¥ JXH , CsF 



KxR 



and an integer parameter m: 



?*A + k-Q > R + TO, 
&A > W 

C m (A)0C m (B) 



(C m (A)0C m (B))d m = 0, 
deF B 



ru + 

has full column rank; 

d m = 0; 



&A > R + TTl, 
k~B > TO 



(C m (A)©C m (B))d" 
d G range(C T ) 



0. 



0. 



(Km) 
(Cm) 

CUm) 
(Wm) 





(Wm) 


(Wm-l) 


(W2) 


(Wi) 


(Lemma 13. 3[) 


ft 


ft 


ft 


ft 


(Lemma 13. 7p 


(Urn) = 


> (Um-l) . 


. => (Ua) = 


» (Ui) 


(Lemma 13. ip 


ft 


ft 


ft 


ft 


(Lemma I3.6[) 


(Cm) = 


(Cm-l) =*> . 


. => (Ca) = 


^ (Ci) 


(Lemma I3.8[) 


ft 


ft 


ft 


ft 


(Lemma 13. 4[) 


(Km) = 


» (Km-l) =>■ . 


. (Ka) = 


» (Ki) 



(Wa) => (Wi). (1.11) 



In fJ2] we give a formal definition of compound matrices and present some of their 
properties. This basic material will be heavily used in the following sections. 
In S}3]we establish the following implications: 



(1.10) 



as well as (Lemma 13. 12|) 

if min(/cA, &b) > to — 1, then (Wm) => (Wm-i) => . . 

We also show in Lemmas 13 . 51 13.9H3.101 that (jl.101) remains valid after replacing con- 
ditions (Cm),. . . ,(Ci) and equivalence (Ci) 4^ (Ui) by conditions (Hm) r . . ,(Hi) and 
implication (Hi) => (Ui), respectively. 

Equivalence of (Ci) and (Ui) is trivial, since the two conditions are the same. 
The implications (Ka) =4> (C2) =>■ (U2) already appeared in (|1.8I) . The implication 
(Ki) =>■ (Ci) was given in Lemma H. 161 and the implications (Km) (Hm) => (Um) 
are implicitly contained in [20] . From the definition of conditions (Km) and (Hm) it 
follows that ta + f b > R + to. On the other hand, condition (Cm) may hold for 
^a + ^b < R + to. We do not know examples where (Hm) holds, but (Cm) does not. 
We suggest that (Hm) always implies (Cm). 

In 2] we present a number of results establishing the uniqueness of one factor 
matrix under various hypotheses including at least one of the conditions (Km) , (Hm) , 
(Cm), (Um) and (Wm). The results of this section can be summarized as: 
if kc > 1 and m = mc := R — rc + 2, then 



(Cm) 

(ILD) (Km) (Un 

(Hm) 



A B has full column rank, 

(Wm), 

min(fcA, &b) > to — 1 



(1.12) 



j A © B has full column rank, 

j(Wm),(Wm-l),...,(Wl) 

r-j = R and the third factor matrix of T = [A, B, C]r is unique. 
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Thus, Theorems ll.9rfTTTUl are implied by the more general statement (|1.12[) . which 
therefore provides new, more relaxed sufficient conditions for uniqueness of one factor 
matrix. 

Further, compare (|1.12l) to (|1.8p . For the case re = R, i.e., m = 2, uniqueness of 
the overall CPD has been established in Theorem 11.111 Actually, in this case overall 
CPD uniqueness follows easily from uniqueness of C. 

In |j5]we simplify the proof of Theorem II. Ill using the material we have developed 
so far. In Part II [5] we will use (|1.12[) to generalize (|1.8p to cases where possibly 
r c < R, i.e., m > 2. 

2. Compound matrices and their properties. In this section we define com- 
pound matrices and present several of their properties. The material will be heavily 
used in the following sections. 

Let 

S* := {(ti, ... ,**) : 1 < »i <••■<*'*< «} (2.1) 

denote the set of all k combinations of the set {1, . . . , n}. We assume that the elements 
of S„ are ordered lexicographically. Since the elements of S k can be indexed from 1 
up to C„, there exists an order preserving bijection 

a n , k : {1, 2, . . . , C k n } ^S h n = S k n {2), . . . , S h n (C k n )}. (2.2) 

In the sequel we will both use indices taking values in {1, 2, . . . , C„} and multi- indices 
taking values in S k . The connection between both is given by (|2.2j) . 

To distinguish between vectors from ¥ R and F c ™ we will use the subscript £„, 
which will also indicate that the vector entries are enumerated by means of S„. For 
instance, throughout the paper the vectors d G F^ and ds m G F Cr are always defined 

by 

d = [d! d 2 ... d R ] G ¥ R , 
ds™ = [d(i,..., m ) ■■■ d (j u ...,j m ) ■■■ rf (fl-m+i,...,i?)] T e F c « . (2.3) 

Note that if d( il Am ^ = ■ ■ ■ di m for all indices ii,... ,i m , then the vector d$m is 
equal to the vector d m defined in p.9[) . 
Thus, doi = d 1 = d. 

' R 

Definition 2.1. Jfflj Let A G F mxn and k < min(m, n). Denote by 
A(S^ l (i), Sm(j)) the submatrix at the intersection of the k rows with row numbers 
S^ii) and the k columns with column numbers S k n (j). The C^-by-C^ matrix whose 
entry is det A(S^ l (i), S k (j)) is called the k-th compound matrix of A and is 
denoted by Cfe(A). 



Example 2.2. Let 



A = 



ai 1 
a 2 1 
a 3 1 



Then 



Ca(A) = [C 2 (A) 1 C 2 (A) 2 C 2 (A) 3 C 2 (A) 4 C 2 (A) 5 C 2 (A) 6 ] 

= [C 2 (A) (1>2) C 2 (A) (1;3) C 2 (A) (1 , 4) C 2 (A) (2>3) C 2 (A) (2 , 4) C 2 (A) (3 , 4) ] 
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(1,2) 
= (1,3) 
(2,3) 



(1,2) 


(1,3) 


(1,4) 


(2,3) 


(2,4) 


(3,4) 


ai 1 




ai 




ai 




1 




1 







a 2 




a 2 1 




a 2 




1 









1 


di 1 




ai 




ai 




1 




1 







a 3 




a 3 




a 3 1 









1 




1 


a 2 




a 2 1 




a 2 




1 









1 


a 3 




a 3 




a 3 1 









1 








a 2 




a x 10 
ai 1 
-a 3 a 2 1 



Definition 12.11 immediately implies the following lemma. 
Lemma 2.3. Let A G ¥ IxR and k < mm(I,R). Then 

1. d(A) = A; 

2. /// = R, then C R (A) = det(A); 

3. Cfc(A) has one or more zero columns if and only if k > fcA/ 

4. Cfe(A) is equal to the zero matrix if and only if k > rj±. 
The following properties of compound matrices are well-known. 

Lemma 2.4. \15\ p. 19-22] Let k be a positive integer and let A and B be 
matrices such that AB, Cfc(A), and Cfe(B) are defined. Then 

1. Cfc(AB) = Cfc(A)Cfe(B) (Binet-Cauchy formula); 

2. If A is nonsingular square matrix, then Cfc(A) -1 = Cfc(A ); 

3. C k (A T ) = (C k {A)) T ; 

4. C k (l n ) = I ck j 

5. If A is an n x n matrix, then det(Cfc(A)) = det(A) c '"- 1 (Sylvester-Franke 
theorem). 

We will extensively use compound matrices of diagonal matrices. 
Lemma 2.5. Let d G ¥ R , k < R, and let d k be defined by (Q~l]). Then 

1. d k — if and only if 00(d) < k — 1; 

2. d k has exactly one nonzero component if and only if uj(d) = k; 

3. C fc (Diag(d)) =Diag(d fc ). 

Example 2.6. Let d — [d 1 d 2 d 3 d 4 ] T and D = Diag(d). Then 

C 2 (D) =Diag([did 2 did 4 d 2 d 3 d 2 d± d 3 d 4 ] ) = Diag(d 2 ), 

C 3 (D) =Diag([did 2 d 3 did 2 di did 3 d± d 2 d 3 di\ ) — Diag(d 3 ). 



For vectorization of a matrix T — [ti ■■• t^], we follow the convention that 
vec(T) denotes the column vector obtained by stacking the columns of T on top of 
one another, i.e., 

vec(T)=[tf ... tlf. 

It is clear that in vectorized form, rank-1 matrices correspond to Kronecker products of 
two vectors. Namely, for arbitrary vectors a and b, vec(ba T ) = aCg>b. For matrices A 
and B that both have R columns and d G ¥ R , we now immediately obtain expressions 
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that we will frequently use: 

/ R \ R 

vec(BDiag(d)A T ) = vec ^ b r a£d r = ^(a r ® h r )d r = (A B)d, (2.4) 

\r=l / r=l 

ADiag(d)B T = O BDiag(d)A T = O (A B)d = 0. (2.5) 

The following generalization of property (|2.4I) will be used throughout the paper. 
Lemma 2.7. Let A e ¥ IxR , B e ¥ JxR , d e ¥ R , and k < min(J, J, R). Then 

vec(C fc (BDiag(d)A T )) = [C k (A) C k (B)]d k , 

where d k 6 F c « is defined by (|1.9[) . 

Proof. From Lemma [2^41 (1).(3) and Lemma T2.5I f3~) it follows that 

C fc (BDiag(d)A T ) = C fc (B)C fc (Diag(d))C fc (A T ) = C fe (B)Diag(d fc )C fe (A) T 

By (El, 

vec(C fe (B)Diag(d fc )C fc (A) T ) = [C fc (A) C fc (B)]d fe . □ 

The following Lemma contains an equivalent definition of condition (Um). 

Lemma 2.8. Let A e ¥ IxR and B e ¥ JxR . Then the following statements are 
equivalent: 

(i) if d £ F fi is smc/i i/iai ^ADiag(d)B T < m — 1; t/ien w(d) < m — 1; 

(ii) (Um) holds. 

Proof. From the definition of the m-th compound matrix and Lemma [2.7l it follows 

that 

^ADia g (d)Br = r BDiag{d)A T < m - 1 C m (BDiag(d)A T ) = O 

<S> vec(C m (BDiag(d)A T )) =0 <s> [C m (A)©C m (B)]d m =0. 

Now the result follows from Lemma \2. 51 (1). □ 

The following three auxiliary lemmas will be used in Sj3] 

Lemma 2.9. Consider A e ¥ IxR and B <G ¥ JxR and let condition (Um) hold. 
Then min(fcA, k&) > m. 

Proof. We prove equivalently that if min(fcA,fcB) > fn does not hold, then (Um) 
does not hold. Hence, we start by assuming that min(/cA,^B) — k < m, which 
implies that there exist indices ii,...,i m such that the vectors & il ,...,EL im or the 
vectors , . . . , b^ m are linearly dependent. Let 

1, i S {h, . . . , i m }] 
0, i g . . . ,i m }, 

and let d m G F c « be given by (jl.9|) . Because of the way d is defined, d m has exactly 
one nonzero entry, namely ■ ■ • di m . We now have 

(C m (A) C m (B))d m = C m ([a n . . . a im ] ) C m {[b n . . . b im ] )d il ■ ■ ■ d im = 0, 

in which the latter equality holds because of the assumed linear dependence of , 
. . . , aj m or b^ , . . . , hi m . We conclude that condition (Um) does not hold. □ 



[di 



d R \ 



di := 
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Then there exists a linear mapping $ /: ™ : W 1 — > 
C m ([A x]) = $ J ' m (x)C m _i(A) for all A G W Ix ^ m ~^ and for all xeF 1 . (2.6) 



Lemma 2.10. Let m < I 

jpcrxc™- 1 such that 



Proof. Since [A x] has m columns, C m ([A x]) is a vector that contains the determi- 
nants of the matrices formed by m rows. Each of these determinants can be expanded 
along its last column, yielding linear combinations of (m — 1) x (m — 1) minors, the 
combination coefficients being equal to entries of x, possibly up to the sign. Overall, 
the expansion can be written in the form (I2.6[) . in which $ /,m (x) is a C} n x C™ _1 
matrix, the nonzero entries of which are equal to entries of x, possibly up to the sign. 
More in detail, we have the following, 
(i) Let A G F mx ( m_1 ), x G F m . By the Laplace expansion theorem [13 p. 7], 



Cm ([A x]) = det([A x]) = [x m -x m -i x m _ 2 
Hence, Lemma [2.101 holds for m = I with 

$ m,m (x) = [x m -X m -! X m - 2 ■ 



(-l)™" 1 ^] C m _ x (A). 



Let us dchnc 



(ii) Let m < I. Since, C m ([A x]) = \d\ ... dcyA , it follows from the 
definition of compound matrix that di = C m ([A x]), where [A x] is a submatrix of 
[A x] formed by rows with the numbers o~j m (i) = S m (i) '■— ■ ■ ■ ,i r , 
$,(x) G F lxC " 1_1 by 

$<(x) - [ . . . x lm ... (-l)™- 1 ^ 

t t t 

1 3m 3l 



h :=o-/j„-i((*2,---,«m)) 

x h ]C m -i(A) = $i(x)C m _i(A) 



where 

3m ■■= °~T, m -i((h, ■ ■ -,i m -i)), ■ ■ 
and aj 1 m _ 1 is defined by $2/2$) ■ Then by (i), 

d% == C m ([A X]) = \_Xi m ^im-l • m • ( ^) 

The proof is completed by setting 

" dh(x) 
$ J '™(x) = : 

$ cr (x) 

Example 2.11. Let us illustrate Lemma Y2.10\ for m — 2 and 1 = 4. If 
A = [an a,2i 0,31 a 4i] > then 



C 2 ([A x])=C 2 ( 



□ 









x 2 an 


- 2ia 2 i 




2 2 


-21 










an 


X\ 




x 3 an 


- 2ia 3i 




23 





-21 







an 


an 


X2 


) = 


cc4an 


— 21041 




X4 








-21 




a 2 i 


az\ 


23 




^3021 


- 2 2 a 3 i 







2 3 


-2 2 







031 


a 4i 






24^21 


— 2 2 a4i 







24 





-2 2 




_a 4 i 








24031 


- 2 3 a 4 i 










X4 


-23 





$ 4 ^(x)Ci(A) 
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3. Basic implications. In this section we derive the implications in (ll.lOj) and 
(fTTl|) . We first establish scheme (fTTU|) by means of Lemmas O EZ3 EH EH EH 
l3~Tlandl3~gl 

Lemma 3.1. Let A E ¥ IxR , B E ¥ JxR , and2<m< min(J, J). Then condition 
(Cm) implies condition (Um). 

Proof. Since, by (Cm), C m (A) C m (B) has only the zero vector in its kernel, it 
does a forteriori not have an other vector in its kernel with the structure specified in 

(Um). □ 

Lemma 3.2. For A E ¥ IxR and B E W JxR . Then 

(Ci) (Ui) <^> A B has full column rank. 

Proof. The proof follows trivially from Lemma |2~51 1 . since d 1 = d. □ 
Lemma 3.3. Let A E ¥ IxR , B e ¥ JxR , andl<m< min(7, J). Then condition 
(Um) implies condition (Wm) for any matrix C E p Kx R_ 

Proof. The proof trivially follows from the definitions of conditions (Um) and 

(Wm). □ 

Lemma 3.4. Let A e ¥ IxR , B e ¥ JxR , and 1 < m < min(J, J). Then condition 
(Km) implies conditions (Km-i),...,(Ki). 
Proof. Trivial. □ 

Lemma 3.5. Let A e ¥ IxR , B e ¥ JxR , and 1 < m < min(J, J). Then condition 
(Hm) implies conditions (Hm-i),...,(Hi). 
Proof. Trivial. □ 

Lemma 3.6. Let A e ¥ IxR , B e W JxR , and 1 < m < min(7, J). Then condition 
(Cm) implies conditions (Cm-i),. . . ,(Ci). 

Proof. It is sufficient to prove that (Ck) implies (Ck-i) for k 6 {m, m — 1, . . . , 2}. 
Let us assume that there exists a vector d f=-i S F c « such that 

[C fc _i(A)OCk_i(B)]dg*-i =0, 

which, by (|2 . 5[) . is equivalent with 

C fc _i(A)Diag(d s ,- 1 )C fe _i(B) T = O. 

Multiplying by matrices $ 7 ' fc (a r ) E ¥ c ' xC i 1 and $ J ' fc (b r ) E W°J xC J~ , constructed 
as in Lemma 12.101 we obtain 

$ / ^(a r )C fc _ 1 (A)Diag(d sfc - 1 )C fc _ 1 (B) T $^ fc (br) T = O, r = 1, . . . , R, 

which, by f|2.5p , is equivalent with 

[($ T ' fe (a r )C fc _ 1 (A)) 0(<f J ' fc (b r )C fe _ 1 (B))]d s ,- 1 =0, r=l,...,R. (3.1) 

By 421]), 

$ 7 ' fc (a r )Cfe_i([a il ... aj^J) = C fc ([a, 1 ... a^^j a r ]) = 

0, ifrG{ii,...,t fc _i}; (3-2) 

±C ; (A)[t lii2) ... A _ 1>r ], if r g {ii, . . 
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where Cfc(A)« 1 ^ 2 i h _ 1 r i denotes the [ii, *2j • ■ • > *fc-ij r ]~th column of the matrix 
Cfc(A), in which [i\,t2, ■ ■ ■ , ik-i, r ] denotes an ordered fc-tuple. (Recall that by 
the columns of C&(A) can be enumerated with S^.) Similarly, 

Now, equations (|3.1[) — ()3.3|) yield 

X! ( C fc( A )[u,»2,-,«i.-i,'-] ® C fc( B )[ii,ii,.".*fc-i.»-]) = °> 



l<ii<— <ik-i<R 
ii,...,i),_i/r 



(3.4) 



r = l,...,i?. 

Since C&(A) Cfc(B) has full column rank, it follows that for all r = 1, . . . , R, 

di^ » fc _i) = 0, whenever 1 < ii < • • • < ifc_i < R and ii,.. . , ifc-i 7^ r. 

It immediately follows that d,»-i = 0. Hence, C/-_i(A) 0Cn(B) has full column 
rank. □ 

Lemma 3.7. Let A e ¥ IxR , B e ¥ JxR , and 1 < to < min(J, J). TTien condition 
(Um) implies conditions (Um-i) ; . . . ,(Ui). 

Proof. It is sufficient to prove that (Uk) implies (Uk-i) for k £ {m, m — 1, . . . , 2}. 
Assume to the contrary that (Uk-i) does not hold. Then there exists a nonzero vector 
d fe_1 such that [C fc _i(A) C k -i(B)] d fc_1 = 0. Analogous to the proof of Lemma [3?6l 
we obtain that (13.41) holds with 



rf (»i,...,i fc -i) = ■■■di k _ 1 , (h, ■ ■ ■ ,ik-i) G Sx , 1 . (3.5) 
Thus, multiplying the r-th equation from (|3.4p by d r , for 1 < r < iZ, we obtain 



XI ^i"-^fc-i^( C *( A )[ii,i2,...,» fc -i,r] ®C]fe(B) [il)ia) ... jifc _ 1)r] ) =0. (3.6) 

l<ii<-<i fc _i<7? 
ii,...,ife_i5^r 

Summation of ()3.6j) over r yields 



fc[C fe (A)0C fc (B)]d fe = O. (3.7) 

Since (Uk) holds, (|3.7|) implies that 

d h ■■■d ik =Q, («i,...,ifc) G <S^. 

Since d fe_1 is nonzero, it follows that exactly A; — 1 of the i? values d\,. . . ,du are 
different from zero. Therefore, d* -1 has exactly one nonzero component. It follows 
that the matrix Cfe_i(A) Cfc_i(B) has a zero column. Hence, min(fcA, &b) < fc — 2. 
On the other hand, Lemma [2.9l implies that min(/cA, ^b) > k, which is a contradiction. 
□ 

The following lemma completes scheme (ll.iop . 

Lemma 3.8. Let A e F /x/? , B e F jx - R , and to < min(/, J). Then condition 
(Km) implies condition (Cm). 
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Proof. We give the proof for the case + k-g > R + m and k\ > m; the case 
r B + > R + m and k-g > m follows by symmetry. We obviously have k-g > m. 

In the case &b = m, we have ta = R. Lemma VTM (5) implies that the C™ x Cj^ 
matrix C m (A) has full column rank. The fact that k& = m implies that every 
column of C m (B) contains at least one nonzero entry. It immediately follows that 
C m (A) C m (B) has full column rank. 

We now consider the case ks > m. 
(i) Suppose that [C m (A) ©C m (B)]d,g™ = Oc™cy for some vector dg™ <E ¥ c r . 
Then, by iB. 



C m (A)Diag(d s ^)C m (B) T = j»xcy 



(3- 



(ii) Let us for now assume that the last ta columns of A are linearly indepen- 
dent. We show that rf(fe B - m+ i,...,fe B ) = 0. 

By definition of k&, the matrix X := [bi . . . bfe B ] has full row rank. Hence, 
XX^ = I kB , where denotes a right inverse of X. Denoting 



Y := X 1 



-m) X m 



wc have 



BY 



Dfc B + l • ■ 

3(_R-fe B )xfe E 



bfl 
O 



xt 



o 



(&B — m) X m 



(/cb — m) X? 



^(&B — tti) xm 
B3(i?-fe B )xm 



where 



denotes a p x q matrix that is not further specified. From the definition 



of the rn-th compound matrix it follows that 



-C 



Oc 

1 



R-k B +r 



-l)xl 



(3.9) 



We now have 



Ocp = Ocyxcy ■ C m (Y) 

^ C m (A)Diag(ds-)C m (B T ) • C m (Y) 
= C m (A)Diag(d s -)Cm(B T Y) 



£03 



Cm (A) 



«(fc B -m+l,...,fc B ) 

ffl (C2U B+m -i)xi 



(3.10) 



Since the last ta columns of A are linearly independent, Lemma l2.4l (5) implies that 
the Cf 1 x matrix M = C m (\a.jt-r A +i ■■■ a fl]) h &s full column rank. By 



definition, M consists of the last columns of C m (A). Obviously, r& + fcs > 



R 



m implies C™ > C%_ km+m . 



Hence, the last C 



columns of C m (A) 



are linearly independent and the coefficient vector in (|3.10p is zero. In particular, 



l (fcs-„ 



,k B ) 



0. 
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(iii) We show that <%!,... Jm ) = for any choice of j\, J2, ■ ■ ■ , j m , 1 < ji < • • • < 



Since £a > Tn, the set of vectors , . . . , a Jm is linearly independent. Let us extend 
the set a.j 1 , . . . , a.j m to a basis of range(A) by adding rA — m linearly independent 
columns of A. Denote these basis vectors by , . . . , a.j m , &j m+1 , • ■ • , &j r ■ It is clear 
that there exists an R x R permutation matrix II such that the (AII)7?_ rA+ i = 
a.j 1 , . . . , (All) n = a.j r , where here and in the sequel (All),, denotes the r-th column 
of the matrix All . Moreover , since fee — m + 1 > R — t a + 1 we can choose n such that 
it additionally satisfies (An) feB _„ l+ i = a il7 (An)fc B _ TO+2 = a j2 , . . . , (An) fcs = a jm . 
We can now reason as under (ii) for An and BII to obtain that d(j lt ,,,j m ) = 0. 

(iv) From (iii) we immediately obtain that dg™ = 0. Hence, C m (A) 0C ra (B) 
has full column rank. 



We now give results that concern (Hm). 

Lemma 3.9. Let A e ¥ IxR , B e W JxR , and to < min(7, J). Then condition 
(Km) implies condition (Hm). 

Proof. We give the proof for the case ta + &b > R + Tn and &a > Tn; the case 
fB + ^a > R + m and /cb > Tn follows by symmetry. We obviously have ks > to. 

(i) Suppose that S < m. Then ?a = r B = ^- H cnce ) = 

(ii) Suppose that S > to and S > k&. Then > fee- Let A c denote the 
I x (R — 5) matrix obtained from A by removing the columns that are also in A. 
Then r A > r A — ?' AC . Hence, r A +rg — <5 > r A — r A c + r B — ^ — r A~ <5)+fcB — <5 > m. 
Thus, i?(<5) > to. 

(iii) Suppose that k& > 8 > m. Then 73 = 6. Since r A > min(<5, fc A ) > m, it 
follows that r A + — 6 > m + S — S = m. Thus, H (§) > m. 



Lemma 3.10. Let A 6 ¥ IxR , B e W JxR , and m < min(7, J). Then condition 
(Hm) implies condition (Dm). 

Proof. The following proof is based on the proof of Rank Lemma from [20l p. 
121]. Let (C m (A) C m (B))d m = for d m associated with d e ¥ R . By LemmaEH 
C m (BDiag(d)A T ) = C m (B)Diag(d m )C m (A) T = O. Hence, r B Diag(d)A^ < m-1. Let 
cj(d) = S and = ■ ■ ■ = di R _ s = 0. Form the matrices A, B and the vector d by 
dropping the columns of A, B and the entries of d indexed by i\, . . . , Irs- From the 
Sylvester rank inequality we obtain 

min(<5, m) < H(S) <r^+r A -5 = r Sraag(a) + r Diag(a)A - r Diag(a) 

^ r BDiag(d)AT = r BDiag(d)A T < TO - 1. 

Hence, 5 < m — 1. From Lemma [^751 1) it follows that d m = 0. □ 
The remaining part of this section concerns (|1.11[) . 
Lemma 13.71 and Lemma 12.91 can be summarized as follows: 



The following example demonstrates that similar implications do not necessarily hold 
for (Wm). Namely, in general, (Wm) does not imply any of the following conditions: 



3 m < R- 



□ 



□ 




(Wk) for k < m — 1, 
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A © B has full column rank, 
min(fcA, k&) > m — 1. 



Example 3.11. Let m = 2 and let 



A = 



10 1 
10 1 



B 



1 1 

1 1 2 



C = 



10 
110 1 



Let us show that condition (W2) holds but condition (Wi) does not hold. It is easy to 
check that 



A B 



10 1 

2 

1 

10 2 



Ca(A)0Ca(B)= [1 2 1 0] 



Let d £ range(C T ). Then there exist x\,X2 G F such that d = [22 £2 %i ^2] 
Hence, d 2 = \x\ x\Xi x\ x\Xi x\ x\Xi\ T ■ Therefore 



(C 2 (A) C 2 (B))d 2 = x 2 = u(d) < 1 = 2 - 1 
(A©B)e£ = 0, e^ e range(C T ), w(ef) = 1 > 1 - 1 



►(W2) fcoZds, 

>(Wi) does noi ftoZd, 



where e| 



[0 1 0] . In particular, A B does not have full column rank. 
Besides, since the matrix A has a zero column, it follows that min(fcA,fcB) = < 
m — 1 . 

The following lemma now establishes (|1.11[) . 

Lemma 3.12. Let A e ¥ IxR , B e F Jxfl , C e w KxR , 1 < m < min(7, J), and 
min(fcA, fee) > TO — 1. T/ie« condition (Wm) implies conditions (Wm-i),. . . ,(Wi). 

Proof. The proof is the same as the proof of Lemma 13. 7\ with the difference that 
instead of Lemma 12.91 we use the condition min(fcA, &b) > to — 1. D 

4. Sufficient conditions for the uniqueness of one factor matrix. In this 
section we establish conditions under which a PD is canonical, with one of the factor 
matrices unique. We have the following formal definition. 

Definition 4.1. Let T be a tensor of rank R. The first (resp. second or third) 
factor matrix of T is unique if T = [A, B, C]r = [A, B, C]r implies that there exist 
an Rx R permutation matrix II and an Rx R nonsingular diagonal matrix Aa ( resp. 
Ab or Ac ) such that A = AIIAa (resp. B = BIIAb or C = CIIAc). 

4.1. Conditions based on (Um), (Cm), (Hm), and (Km). First, we recall 
Kruskal's permutation lemma, which we will use in the proof of Proposition 14.31 

Lemma 4.2. \16 [\20§MI Consider two matrices C G F K * R and CeF M such 
that R < R and kc > 1. If for every vector x such that u;(C T x) < R — r c + 1, we 
have w(C T x) < w(C T x), then R — R and there exist a unique permutation matrix II 
and a unique nonsingular diagonal matrix A such that C = CIIA. 

We start the derivation of (|1.12p with the proof of the following proposition. 

Proposition 4.3. Let A e ¥ IxR , B e F Jxi? , C e F Kxfl , and let T = 
[A,B,C]fl. Assume that 

(i) fee > l; 

(ii) m = R - r c + 2 < min(J, J); 
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(iii) condition (Um) holds. 
Then rj- = R and the third factor matrix of T is unique. 

Proof. Let T =_[A,B,C] 5 be a CPD of T, which implies R < R. We have 
(A B)C T = (A B)C T . We check that the conditions of Lemma B~2l are satisfied. 
From Lemma ETT1 it follows that conditions (Um-i), . . . , (U2), (Ui) hold. The fact that 
(Ui) holds, means that A B has full column rank. Hence, 

rc = r C T = r (AQB)C T = ?7a©b)c t < v & = r c- (4- 1 ) 

Consider any vector x e ¥ K such that 

cj(C t x) := k - 1 < R - rc + 1, 

as in Lemma l4~2l Then ?~ADiag(c T x)B T < k — 1 and, by (|4.1|) . 

R-r c + l<R-rc + l = m-l, 

which impliesjc < m. We have (A B)C T x = (A B)C T x so ADiag(C T x)B T = 
ADiag(C T x)B T . From Lemma[lU;i) it follows 

C fc (ADiag(C T x)B T ) = C fc (ADiag(C T x)B T ) 

= C fc (A)C fe (Diag(C T x))C fc (B T ) 
= 0, 

in which the latter equality follows from Lemma T2.5f 1). Hence, by Lemma [2~7l 

(C k (A)QC k (B))d k = 

for d :— C T x S ¥ R . Since condition (Uk) holds for A and B, it follows that w(C T x) < 
k - 1 = w(C T x). Hence, by Lemma |4.2| R = R and the matrices C and C are the 
same up to permutation and column scaling. □ 

The implications (Cm) (Um) and (Hm) (Um) in scheme (|1.10j) lead to Corol- 
lary 14.41 and to Theorem I1.10[ respectively. The implication (Km) (Cm) in turn 
leads to Corollary 14. 51 Clearly, conditions (Cm), (Hm), and (Km) are more restrictive 
than (Um). On the other hand, they may be easier to verify. 

Corollary 4.4. Let A e ¥ IxR , B e ¥ JxR , C e ¥ K xR , and let T = [A, B, C] R . 
Assume that 

(i) fee > l; 

(ii) m = R-r c + 2< min(7, J); 

(iii) C m (A) ©C m (B) has full column rank. (Cm) 
Then rj- — R and the third factor matrix of T is unique. 

Corollary 4.5. Let A e ¥ IxR , B e ¥ JxR , C e F Xxi? ; anrf T = [A,B,C] R . 
Let also m := R — ?*c + 2. // 

?"a + k-B > R + m, 
fee > 1 

then rj- = i? and £/ie f/iird factor matrix of T is unique. 

Remark 4.6. Condition (ii) in Proposition ^. 3\ and Corollary \4-.4\ guarantees that 
the matrices C m (A) and C m (B) are defined. In Corollary \4-5\ (Km) cannot hold if 



[ 7" B + k A > R + m, 
or < fc B > m, (4.2) 

I fee >1, 
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m = R — ?'c + 2 > min(/, J). 

Corollary 4.7. Let A e F /xK , B e ¥ JxR , C e F Xxi? ; and T = [A,B,C]j 
Let also m := R — ?'c + 2. J/ 



fc c > 1, 

min(fcA, ks) > m, 

max(r A + k B ,r B + &a) > R + m, 



(4.3) 



£/ien T'y = R and the third factor matrix of T is unique. 

Proof. It can easily be checked that (|4.3[) and (|4.2p are equivalent. □ 

Remark 4.8. It is easy to see that Corollaries \^.5\ and |^.7] are equivalent to 

Theorem ] 1.91 Indeed, if m = R — rc + 2, then 



k c > 1, 
1.7|) <^ < min(A;A, ^b) > m, 

kA + + max(r A - k A ,r B - fee) > R + m 



4.2. Conditions based on (Wm). In this subsection we deal with condition 
(Wm). Similar to condition (Dm) in Proposition 14. 3[ condition (Wm) will in Propo- 
sition 14.91 imply the uniqueness of one factor matrix. However, condition (Wm) is 
more relaxed than condition (Um). Like condition (Um), condition (Wm) may be 
hard to check. We give an example in which the uniqueness of one factor matrix can 
nevertheless be demonstrated using condition (Wm). 

Proposition 4.9. Let A e ¥ IxR , B e F Jxfi . C e W KxR , and let T = 
[A,B, C]r. Assume that 

(i) fc c > l; 

(ii) m = R-r c + 2< mhx(I, J); 

(iii) A B has full column rank; 

(iv) conditions (Wm), . . . , (Wi) hold. 

Then rf = R and the third factor matrix of T is unique. 

Proof. The proof is analogous to the proof of Proposition ^. 3[ with two points of 
difference. Namely, the fact that A B has full column rank does not follow from 
(Wi) but is assumed in condition (iii). Second, w(C T x) < cj(C t x) follows from (Wk) 
instead of (Uk). □ 

From Lemmas 13.71 and 13.31 it follows that Proposition 14.91 is more relaxed than 
Proposition 14.31 

Combining Proposition |L9] and Lemma[3J2]we obtain the following result, which 
completes the derivation of scheme (|1.12|) . 

Corollary 4.10. Let A e V IxR , B e W JxR , C e ¥ KxR , and let T = 
[A, B, C]_r. Assume that 

(i) k c > 1; 

(ii) m = R-r c + 2< min(7, J); 

(iii) min(fcA, ^b) > m — 1; 

(iv) A B has full column rank; 

(v) condition (Wm) holds. 

Then rf = R and the third factor matrix of T is unique. 
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Example 4.11. Let T= [A, 



A = 



C = 



1 


1 














1 





1 











1 








1 








1 











1 
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k A = k&=4, r A = r B = 6, kc = 1, r c =A, m = 5. 

Since min(fcA, ^b) < m j it follows from Lemma \2.9\ that condition (Um) does not hold. 
We show that, on the other hand, condition (Wm) does hold. One can easily check 
that the rank of the 36 x 21 matrix U = Cs(A) Cs(B) is equal to 19. Obviously, 
both the (1, 2, 3, 4, 5)-th and the (1, 4, 5, 6, 7)-th column o/U are equal to zero. Hence, 
if Ud 5 = for d = [di ... e^l , then at most the two entries did2d^d^d 5 and 
did^d^dgd-r of the vector d 5 are nonzero. Consequently, for a nonzero vector d 5 we 
have 



d-2 = d 3 — 0, f d 6 = d 7 = 0, 

d\d^d^d§d*j ^ 1 d\d2d-$d^d§ ^ 0. 



(4.4) 



On the other hand, since d G range(C T ), there exists x G F 4 such that 

d = C T x = \x\ + Xi X2 £3 x\ X2 X3 X4] . (4-5) 

One can easily check that set (|4.4[) does not have solutions of the form (|4.5[) . Thus, 
condition (Ws) holds. 

Corollary \JA8\ implies that A©B has full column rank. Thus, by Corollary ^. 1C\ 
Tf = 7 and the third factor matrix of T is unique. 

Note that, since kc — 1, it follows from Theorem \1.14\ that the CPD T = 
[A,B,C]7 is not unique. 

5. Overall CPD uniqueness. 

5.1. At least one factor matrix has full column rank. The results for the 
case rc = R are well-studied. They are summarized in (|1.8|) . In particular, Theorems 
11.111 H~T2l and 1X7X31 present (U2), (C2) and (K2), respectively, as sufficient conditions 
for CPD uniqueness. 

The implications (i)o(ii) ^(hi) in Theorem 11.111 were proved in [X5]. The core 
implication is (ii)=>(iii). This implication follows almost immediately from Proposi- 
tion |X3l which establishes uniqueness of C, as we show below. Implication (iii)=>(i) 
follows from Theorem II .151 Together with an explanation of the equivalence (i)<^(ii) 
we obtain a short proof of Theorem 11.111 

Next, Theorem 11.121 follows immediately from Theorem 11.111 Theorem 11.131 in 
turn follows immediately from Theorem 1 1.1 21 cf. scheme (I1.10[) . 
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Proof of Theorem ] 1 . 1 11 (i)<^>(ii): Follows from Lemma 12.81 for m = 2. 

(ii) =>(iii): By Proposition 231 r-j- — R and the third factor matrix of T is unique. 
That is, for any CPD T = [A, B,C]fl there exists a permutation matrix II and a 
nonsingular diagonal matrix Ac such that C = CIIcAc- 

Then, by flU}, (A B)C T = (A B)C T = (A B)A c ngC T . Since the 
matrix C has full column rank, it follows that A B = (A B)AcII^. Equating 
columns, we obtain that there exist nonsingular diagonal matrices A a and Ab such 
that A = AIIcA A and B = Bn c A B , with A A A B A C = Ir- Hence, the CPD of T 
is unique. 

(iii) =>(i): follows from Theorem II. 151 □ 

Proof of Theorem ] 1 . 1 2[ Condition (C2) in Theorem ll.l2l triviallv implies condition 
(U2) in Theorem II. Ill Hence, rj- = R and the CPD of T is unique. □ 

Proof of Theorem I l.lSfc By Lemma 13.81 condition (K2) in Theorem 11.131 implies 
condition (C2). Hence, by Theorem II .121 rj- = R and the CPD of T is unique. □ 

Remark 5.1. The results obtained in (see the beginning of subsection \ 1 . 
can be completed as follows. Let T = [A, B,C]^ 7 2 < r-j- = R < 4. Assume without 
loss of generality that rc > max(rA,rB)- For such low tensor rank, we have now 
a uniqueness condition that is both necessary and sufficient. That condition is that 
rc = R and (U2) holds. Also, for R < 3, (K2), (H2), (C2), and (U2) are equivalent. 
For these values of R, condition (K2) is the easiest one to check. For R = 4, (H2), 
(C2), and (U2) are equivalent. The proofs are based on a check of all possibilities and 
are therefore omitted. 

5.2. No factor matrix is required to have full column rank. Kruskal's 
original proof (also the simplified version in [32]) of Theorem 11.81 consists of three 
main steps. The first step is the proof of the permutation lemma (Lemma 14. 2| . The 
second and the third step concern the following two implications: 

k A + k B + k c > 2R + 2 

'k A + k B + k c > 2i? + 2, 

r r - R, (5.1) 
every factor matrix in T = [A, B, C\r is by itself unique 

the overall CPD T = [A, B, C]r is unique. 

That is, the proof goes via demonstrating that individual factor matrices are unique. 
Similarly, the proof of uniqueness result (ii)<J4>(iii) in Theorcm ll.lll for the case rc = R, 
goes, via Proposition l4.3l in two steps, which correspond to the proofs of the following 
two equivalences: 



(U2) ^ 



r T = R, 

the third factor matrix of T = [A, B, C]/? is unique (5.2) 
the CPD of T is unique. 



Again the proof goes via demonstrating that one factor matrix is unique. Note that 
the second equivalence in (|5.2j) is almost immediate since C has full column rank. In 
contrast, the proof of the second implication in (|5.ip is not trivial. 

Scheme (|1 . 12|) generalizes the first implications in (|5.ip and (|5.2[) . What remains 
for the demonstration of overall CPD uniqueness, is the generalization of the second 
implications. This problem is addressed in Part II [5]. Namely, part of the discussion 
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in [5] is about investigating how, in cases where possibly none of the factor matrices has 
full column rank, uniqueness of one or more factor matrices implies overall uniqueness. 

6. Conclusion. We have given an overview of conditions guaranteeing the 
uniqueness of one factor matrix in a PD or uniqueness of an overall CPD. We have 
discussed properties of compound matrices and used them to build the schemes of 
implications (jl.lOp and (jl.lll) . For the case rc = R we have demonstrated the overall 
CPD uniqueness results in (|1.8[) using second compound matrices. Using (jl.101) and 
()l.lip we have obtained relaxed conditions guaranteeing the uniqueness of one factor 
matrix, for instance C. The general idea is to the relax the condition on C, no longer 
requiring that it has full column rank, while making the conditions on A and B more 
restrictive. The latter are conditions on the Khatri-Rao product of m-th compound 
matrices of A and B, where m > 2. In Part II [8] we will use the results to derive 
relaxed conditions guaranteeing the uniqueness of the overall CPD. 
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